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FOREWORD 


Content  of  this  Research  Memorandum  constitutes  a  portion  of  a 
dissertation  submitted  to  the  graduate  faculty  of  the  University  of 
Minnesota  in  partial  fulfillment  of  the  degree  Doctor  of  Philosophy, 
'March  1964. 

^  Ste” study  deals  with  the  selection  of  moderator  variables.  The 
term  "moderator"  is  defined  by  the  author  as  referring  to  any  variable, 
quantitative  or  qualitative,  which  improves  the  usefulness  of  a  predic¬ 
tor  by  isolating  subgroups  of  individuals  for  whoa  a  predictor  or  set 
of  predictors  is  especially  appropriate.  A  method  is  described  for  se¬ 
lecting  moderator  variables  for  use  with  predictors  of  performance  in 
three  groups— clerical,  skilled,  nonskilled—first,  when  predictors 
specific  to  the  groups  are  employed,  and  second,  when  a  more  general 
predictor  is  used  with  all  three  groups. 


! 


EMPIRICAL  TRANSSITUATIONAL  MODERATORS 


STATEMENT  OF  THE  PROBLEM 


Considerable  interest  has  focused  on  the  concept  of  the  moderator  vari¬ 
able  over  the  past  few  years.  The  possibility  of  enhancing  validity  by 
identifying  variables  which  improve  the  usefulness  of  a  predictor  by  iso¬ 
lating  subgroups  of  individuals  for  whom  a  predictor,  or  a  set  of  regres¬ 
sion  weights  are  especially  effective  has  attracted  the  attention  of  many 
psychologists.  The  body  of  literature  leading  up  to  current  formulations 
of  theory  on  moderator  variables  has  been  described  by  the  author  (Benas, 
1964). 


Evidence  has  seemed  to  indicate  that  the  usefulness  of  subgrouping 
analysis  may  be  limited  because  of  the  apparent  specificity  of  moderator 
variables.  For  instance,  Ghiselli  (1965b)  examined  the  similarity  of 
moderators  developed  through  item  analysis  of  an  inventory.  With  different 
tests  predicting  the  same  criterion  for  a  given  group,  and  with  the  same 
test  predicting  similar  criteria  for  two  different  groups,  the  items  which 
formed  the  moderators  were  quite  different.  Ghiselli  concluded  that  moder¬ 
ators  appear  to  be  highly  specific.  Other  studies— not  designed  expressly 
to  investigate  the  specificity  of  moderators— have  reported  conflicting 
findings  when  the  moderator  has  been  used  with  similar  samples,  predictors, 
and  criteria  in  different  situations.  If  it  could  be  demonstrated  that 
moderators  are  not  necessarily  specific  to  particular  situations,  the  po¬ 
tential  of  the  moderator  concept  would  certainly  be  enhanced. 

The  purpose  of  the  present  study  was  to  explore  the  possibility  of 
identifying  one  type  of  trans situational— or  trans -predict or— moderator. 
Specific  questions  asked  were:  (l)  Can  a  moderator  be  found  that  will 
identify  more  predictable  and  less  predictable  subgroups  within  different 
occupational  groups  when  different  predictors  are  used  for  each  group  to 
predict  the  same  kind  of  criterion?  (2)  Can  a  moderator  be  found  that 
will  identify  more  predictable  and  less  predictable  subgroups  within  dif¬ 
ferent  occupational  groups  when  the  same  predictor  is  used  for  all  the 
groups? 


METHOD 


The  method  used  was  based  on  one  proposed  by  Ghiselli  (1956)  in  which 
absolute  differences  between  predicted  criterion  score  and  actual  criterion 
score  are  computed.  Scores  on  experimental  moderators  are  then  correlated 
with  the  difference  scores  to  determine  the  effectiveness  of  the  moderators. 
The  most  eff  ~tive  moderator  composite  for  a  given  sample  is  determined  by 
test  select  on  techniques. 


SAMPLES 


The  present  study  was  based  on  three  groups  designated,  clerical, 
nonskilled,  and  skilled.  Each  occupational  group  was  randomly  divided 
into  an  experimental  sample  for  the  development  of  empirical  moderators 
and  a  cross-validation  sample  for  assessment  of  the  effectiveness  of  the 
moderators . 

Individuals  comprising  the  samples  were  participants  in  a  study  of 
work  adjustment  conducted  by  the  Regional  Vocational  Rehabilitation  Re¬ 
search  Instituted  at  the  Industrial  Relations  Center  of  the  University 
of  Minnesota. 

The  sampling  requirements  of  the  work  adjustment  project  (Carlson, 
Davis,  England,  and  Lofquist,  1963)  stipulated  one  sample  of  handicapped 
persons  for  whom  medical  diagnosis  of  disability  had  been  established  and 
a  control  group  randomly  selected  from  nonhandicapped  workers  in  jobs 
matching  those  of  the  experimental  group.  Samples  for  the  moderator  study 
included  only  clerical,  skilled,  and  nonskilled  workers  on  whom  criterion 
data  were  available.  Occupational  classification  was  based  on  the  individ¬ 
ual's  job  title  using  the  Dictionary  of  Occupational  Titles  (U.  3.  Depart¬ 
ment  of  Labor,  1949).  The  characteristics  of  the  samples  are  presented  in 
Table  1. 


CRITERION 

The  criterion  developed  by  the  Regional  Vocational  Rehabilitation 
Research  Institute  (Carlson  et  al.,  1963),  consisted  of  scores  on  a  five- 
item  performance  scale.  Scores  were  obtained  by  adding  the  scores  on  an 
Alternation  Ranking  Form  and  the  following  items  of  a  Supervisory  Evalua¬ 
tion  Form:  (l)  quality  of  work,  (2)  promotability,  (3)  recommendation 
for  pay  raise,  (4)  adjustment.  The  possible  range  was  5  to  23,  with  the 
higher  score  indicating  a  more  satisfactory  evaluation  by  the  individual's 
immediate  supervisor. 


The  Regional  Vocational  Rehabilitation  Research  Institute  (formerly  known 
as  the  Regional  Research  Center)  was  established  in  the  Industrial  Rela¬ 
tions  Center,  University  of  Minnesota,  on  July  1,  1959*  It  is  a  coopera¬ 
tive  venture  supported  Jointly  by  the  Vocational  Rehabilitation  Adminis¬ 
tration  and  the  University  of  Minnesota.  The  Institute's  core  research 
program.  Work  Adjustment,  has  three  major  objectives:  (l)  the  definition 
and  measurement  of  criteria  of  work  adjustment  among  the  physically  handi¬ 
capped;  ( 2)  the  determination  of  correlates  which  "explain  work  adjust¬ 
ment"  and  (3)  the  development  of  a  systematic  psychology  of  disability. 


Table  1 


SEX,  EDUCATION,  AGE,  AND  DISABILITY  CHARACTERISTICS 
OF  THE  CLERICAL,  NONSKTLLED,  AND  SKILLED  SAMPLES 


Sample 

N 

Median  Age 
(Yrs.) 

Median  Education 
(Irs.) 

Handicapped 
(Per  Cent) 

Females 
(Per  Cent) 

Clerical 

125 

50 

12 

54 

47 

Nonski lied 

ll6 

36 

12 

56 

1 

Skilled 

108 

39 

12 

55 

>1 

Reliability  coefficients  for  the  performance  scale  were  determined  by 
Carlson  et  al.  (1963)  for  samples  similar  to  the  ones  used  in  the  present 
study.  Coefficients  computed  using  Hoyt's  analysis  of  variance  method 
ranged  from  .77  to  .85,  the  median  being  .83. 


PREDICTORS 

Scales  of  the  General  Aptitude  Test  Battery  (GATB),  a  multifactor  test 
battery  developed  by  the  United  States  Employment  Service,  were  used  in  ob¬ 
taining  predicted  criterion  scores  (Dvorak,  1956).  The  GATB  yields  scores 
in  the  following  nine  areas:  Intelligence  (G),  Verbal  (V),  Numerical  (N), 
Spatial  (s).  Form  Perception  (P),  Clerical  (q),  Motor  Coordination  (k). 
Finger  Dexterity  (F),  and  Manual  Dexterity  (M). 

Results  of  studies  cited  in  the  GATB  Manual ,  Section  III  (U.  S. 
Department  of  Labor,  1962)  indicate  that  the  aptitudes  of  the  GATB  are 
measured  reliably  in  situations  in  which  the  battery  is  commonly  used.  In 
studies  conducted  with  samples  similar  to  those  used  in  this  study,  and  with 
intervals  between  initial  testing  and  retesting  ranging  from  one  week  to  one 
yea r,  the  coefficients  of  stability  for  most  of  the  aptitudes  were  in  the 
range  of  .80  to  .90.  Reliability  coefficients  of  the  K,  F,  M  scales  were 
generally  lower  than  for  the  other  scales. 

The  GATB  data  on  aptitude  for  specific  occupations  and  the  occupational 
aptitude  patterns  presented  in  the  GATB  (U.  S.  Department  of  Labor,  19 62) 
were  reviewed.  From  these  data,  predictors  which  had  previously  been  ef¬ 
fective  for  the  kind  of  criterion  and  the  occupational  groups  being  con¬ 
sidered  in  this  study  were  selected  for  use  as  predictors.  The  clerical 
(Q)  scale  was  selected  for  the  clerical  sample,  the  Manual  Dexterity  (m) 


scale  for  the  nonskilled  sanple,  and  the  Spatial  (s)  scale  for  the  skilled 
sample.  The  Intelligence  (G)  scale  had  previously  been  effective  as  a  pre¬ 
dictor  for  the  clerical  and  skilled  samples.  This  finding  suggested  the 
investigation  of  a  transsituational  moderator  to  identify  more  and  less 
predictable  subgroups  for  different  occupational  groups  when  the  same  pre¬ 
dictor  is  used  for  all  the  groups.  Even  though  previous  studies  did  not 
show  that  G  was  related  to  performance  for  nonskilled  samples,  it  was  de¬ 
cided  to  investigate  the  possibility  of  identifying  a  subgroup  from  the 
sample  for  which  G  was  a  predictor.  With  this  objective,  all  three  experi¬ 
mental  samples  were  used  in  the  development  of  both  specific  and  transsit¬ 
uational  moderators  for  the  Intelligence  (G)  scale. 


4n  overview  of  the  literature  on  moderating  effects  indicated  that 
interest  and  personality  scales  of  the  inventory  type  had  not  been  explored 


therefore  selected  as  experimental  moderators,  in  addition  to  the  G  scale 
of  the  GATB: 

MMPI  SVI? 

Hypochondriasis  (Hs) 

Depression  (D) 

Hysteria  (Hy) 

Psychopathic  Deviate  (Pd) 

Interest  (Mf) 

Paranoia  (Pa) 

Psycbasthenia  (Pt) 

Schizophrenia  (Sc) 

Hypcmania  (Ma) 

Introversion-extraversion  (Ie) 


Psychologist  (Ps) 

Engineer  (En) 

Carpenter  (Ca) 

Social  Worker  (SW) 
Accountant  (Ac) 

Office  Man  (Om) 
Occupational  Level  (OL) 
Masculinity-feminity  (Fe) 


systematically  for  other  than  college  populations,  nviaence  repwwu  ™ 
these  populations,  though  not  conclusive,  was  encouraging.  The  following 
scales  of  the  Minnesota  Multiphasic  Inventory  (MMPI)  (Hathaway  and  McKinley 
owl  rvP  +>v>  s+.rr>n£r  Vocational  Interest  Blank  (Strong,  1959)  we.e 


STATISTICAL  ANALYSIS 

The  method  proposed  by  Ghiselli  (1956)  was  used  to  determine  the 
effectiveness  of  the  scales  as  specific  moderators  for  each  of  the  rational 
predictors  selected  for  the  occupational  samples.  This  method  consists  of 
computing  the  difference  scores  between  the  standard  scores  on  the  predic¬ 
tor  and  the  criterion  and  determining  the  effectiveness  of  the  scale  as  a 
moderator  by  correlating  the  scale  with  the  absolute  difference  scores. 

The  higher  the  scale  correlates  with  these  absolute  difference  scores, 
the  more  effective  the  scale  is  as  a  moderator.  Using  these  correlations 
with  the  difference  scores,  and  the  intercorrelations  between  the  scales, 
a  composite  moderator  was  developed  for  each  of  the  predictors  selected 
for  the  samples.  These  specific  moderators  were  developed  on  the  experi¬ 
mental  samples  using  the  modified  Wherry-Doolittle  test-selection  technique. 


A 
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The  effectiveness  of  the  scales  as  transsituational  moderators  was 
also  determined  by  the  method  proposed  by  Ghiselli  (1956).  A  composite 
transsituational  moderator  wa3  developed  for  the  rational  predictors  by 
(l)  combining  the  differences,  regardless  of  sign,  between  the  standard 
scores  on  the  clerical  scale  (Q)  and  the  criterion  for  the  clerical  ex¬ 
perimental  sample,  on  Manual  Dexterity  (M)  and  the  criterion  for  the  non- 
skilled  samples,  and  on  Spatial  (s)  and  the  criterion  for  the  skilled  ex¬ 
perimental  sample;  (2)  obtaining  the  coefficients  of  correlation  of  the 
G  scale,  the  scales  of  the  MMPI,  and  the  scales  of  the  SVIB,  with  these 
combined  difference  scores;  and  (3)  using  these  correlations  with  the 
difference  scores,  and  the  intercorrelations  between  the  scales,  to  de¬ 
velop  a  composite  transsituational  moderator  by  the  modified  VJherry- 
Doolittle  test-selection  technique. 

A  composite  transsituational  moderator  was  developed  for  the  G  scale 
using  the  procedure  described  above.  The  difference  scores  were  derived 
from  the  differences  between  the  standard  scores  on  the  G  scale  and  the 
standard  scores  on  the  criterion. 

The  number  of  scales  retained  in  the  multiple  regression  equation  for 
each  of  the  specific  and  transsituational  moderators  was  determined  by 
applying  the  Wherry  shrinkage  formula: 

*2  „2  /  N-l  1 

'  N-M  / 


where  R  =  the  "shrunken"  multiple  correlation  coefficient 
K  =  the  coefficient  of  alienation 
N  =  the  number  of  cases  in  the  sample 
M  =  the  number  of  predictors 


'Die  S  for  M  +  1  predictors  is  compared'  with  the  8  for  the  M  predictors 
When  R  for  M  +  1  predictors  does  not  exceed  R  for  M  predictors,  the  addi¬ 
tion  of  predictors  is  stopped. 


The  above  test  applies,  in  the  strictest  sense,  only  when  the  M  pre¬ 
dictors  are  chosen  at  random  from  M  +  1  predictors— which  is  not  the  case 
when  predictors  are  added  successively  as  in  the  modified  Wherry-Doolittle 
test-selection  technique.  However,  this  method  is  still  used  widely, 
rather  than  following  each  test  selection  to  its  theoretical  maximum,  or 
arbitrarily  selecting  a  specified  number  of  tests. 


RESULTS 


SPECIFIC  AND  TRANSSITUATI ONAL  MODERATORS 

The  scales  comprising  the  specific  moderators  developed  for  each  of 
the  rational  predictors  specific  to  the  occupational  samples  are  presented 
in  Table  2.  Also  shown  are  Beta  weights  for  the  moderator  scales  and  the 
multiple  correlation  coefficients  computed  in  each  experimental  sample. 

The  scales  comprising  the  trans situational  moderator  developed  on  the 
basis  of  the  combined  difference  scores  for  the  three  experimental  samples 
are  presented  in  Table  3,  together  with  Beta  weights  for  the  moderator 
scales  and  the  multiple  correlation  coefficient  computed  for  the  combined 
experimental  samples. 

Table  4  is  a  comparison  of  the  scales  selected  for  the  specific  and 
for  the  trans situational  moderators.  Scales  are  designated  by  a  plus  (+) 
or  minus  (-)  in  the  appropriate  column  to  indicate  the  sign  of  the  regres¬ 
sion  coefficient.  The  scales  forming  the  specific  moderators  were  found  to 
be  quite  different.  The  three  specific  moderators  did  not  have  one  common 
scale  with  the  same  sign.  These  results  are  similar  to  those  which 
Ghiselli  (1963b)  obtained  with  items  when  he  developed  moderators  through 
item  analysis.  Ghiselli  concluded  that  moderators  appear  to  be  highly 
specific. 

Comparison  of  the  transsituational  moderator  with  the  specific  moder¬ 
ators  also  revealed  little  overlap.  Lack  of  overlap  in  the  composition  of 
composite  moderators  does  not  preclude  the  effectiveness  of  the  transsitua¬ 
tional  moderator.  An  analogous  situation  obtains  in  predictor  research 
when  the  effectiveness  of  separate  regression  equations  for  subgroups  is 
compared  with  the  regression  for  the  total  group.  The  extent  to  which  the 
variables  add  to  prediction  may  differ  in  the  subgroup  and  the  total  group, 
and  test  selection  may  lead  to  regression  equations  with  little  overlap 
when  a  specified  number  of  variables  are  selected  from  a  pool  of  variables. 
Prediction  with  regression  equations  developed  on  the  total  group  may  be 
as  efficient  as  separate  regression  equations  for  the  subgroups  (Horst, 
1959;  Eells,  1961).  In  the  present  study,  the  lack  of  overlap  could  well 
be  due  to  the  smallness  of  the  samples  in  which  the  specific  scales  were 
developed. 

The  scales  comprising  the  specific  moderators  for  the  G  scale,  in  each 
occupational  experimental  sample,  are  presented  in  Table  5.  Table  5  also 
includes  the  corresponding  Beta  weights  for  the  moderator  scales  and  the 
multiple  R's  computed  for  each  of  the  experimental  samples. 
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Table  2 


SCALES  COMPRISING  THE  SPECIFIC  MODERATORS  FOR  THE  RATIONAL  PREDICTORS, 
REGRESSION  COEFFICIENTS,  AND  MULTIPLE  CORRELATION  COEFFICIENTS 
FOR  THE  CLERICAL,  NONSK IDLED,  AND  SKILLED 
EXPERIMENTAL  SAMPLES 


Moderator 

Regression 

Sample 

Predictor 

Scales 

Coefficients 

R 

B 

Clerical 

(N  =  49) 

Hs 

-.189 

Pt 

-.015 

Ma 

-.403 

Q 

le 

-.199 

.44 

Ca 

.291 

Ac 

-.184 

Fe 

-.217 

Nons killed 

(N  =  4?) 

G 

-.273 

Hs 

-.593 

Ky 

.404 

M 

Pd 

-.286 

.61 

Ie 

.239 

sw 

.467 

Ac 

.248 

Skilled 

(N  =  42) 

G 

•  394 

Hs 

.412 

Pd 

.113 

Mf 

.240 

Pt 

-.749 

S 

Sc 

.375 

.70 

Ma 

.213 

Ie 

.242 

Pa 

.454 

SW 

-.265 

Om 

.384 

Table  J 


SCALES  COMPRISING  THE  TRANSSITUATIONAL  MODERATOR  FOR  THE  RATIONAL 
PREDICTORS,  REGRESSION  COEFFICIENTS,  AND  MULTIPLE  CORRELATION 
COEFFICIENT  FOR  THE  COMBINED  EXPERIMENTAL 
SAMPLES  (n  -  1}4) 


Moderator 

Regression 

Scale 

Coefficient 

R 

B 

D 

.116 

Pa 

-.140 

Pt 

-.164 

.25 

Sc 

.117 

Ps 

.193 

The  scales  comprising  the  transsituational  moderator  for  G,  developed 
on  the  basis  of  the  combined  difference  scores  for  the  three  experimental 
samples,  are  presented  in  Table  6.  Table  6  also  includes  the  corresponding 
Beta  weights  for  the  moderator  scales  and  the  multiple  R  computed  for  the 
combined  experimental  samples. 

Table  7  is  a  comparison  of  the  scales  selected  for  the  specific  and 
transsituational  moderators  for  the  G  scale.  The  scales  selected  are 
designated  by  plus  (+)  and  minus  (-)  to  indicate  the  sign  of  the  regression 
coefficient.  Examination  of  this  table  also  reveals  that  the  scales  that 
form  the  specific  and  transsituational  moderators  are  quite  different. 
Furthermore,  the  data  presented  in  Table  7,  like  the  data  presented  in 
Table  4,  Indicate  no  discernable  trend  in  the  functioning  of  personality 
and  interest  scales  as  moderators. 


COMPARISON  OF  THE  SCALES  SELECTED  FOR  THE  SPECIFIC  AND  TRAN  SSI TUAT I ONAL 


Table  5 


SCALES  COMPRISING  THE  SPECIFIC  MODERATORS  FOR  THE  G  SCALE,  REGRESSION 
COEFFICIENTS,  AND  MULTIPLE  CORRELATION  COEFFICIENTS 
FOR  THE  CLERICAL,  NONSKILLED,  AND  SKILLED 
EXPERIMENTAL  SAMPLES 


Sample 

Predictor 

Moderator 

Scales 

Regression 

Coefficients 

R 

B 

Cleri cal 

C\ 

II 

<5 

G 

-.581 

Hs 

-.671 

D 

.049 

Mf 

.469 

G 

Pa 

.189 

.65 

Ma 

-2?5 

Ps 

.190 

Ca 

.329 

SW 

-.312 

Nonskilled 

(N  =  43) 

G 

-.210 

Pd 

-277 

Pa 

-.235 

G 

Ps 

.172 

.60 

En 

-.396 

Ac 

1.&5 

Om 

-1.178 

Skilled 

(N  =»  42) 

G 

.225 

Ks 

-.385 

Hy 

.364 

Mf 

.189 

G 

Ma 

.268 

.66 

Ie 

.447 

Ps 

.546 

SW 

-.a6 

Om 

.408 

10 


SCALES  COMPRISING  THE  TRANSSITUATIONAL  MODERATOR  FOR  THE 
INTELLIGENCE  (G)  SCALE,  AND  THE  MULTIPLE  CORRELATION 
COEFFICIENT  FOR  THE  COMBINED  EXPERIMENTAL 
SAMPLES  (N  «  134) 


Moderator 

Scales 

Regression 

Coefficients 

R 

B 

Hs 

-.139 

Sc 

.116 

Ac 

.312 

.25 

Om 

-391 

QL 

.110 

Fe 

-.220 

EFFECTIVENESS  OF  EMPIRICAL  MODERATORS  FOR  Q,  M,  AND  S 

The  validity  coefficients  of  Q,  M,  and  S  computed  in  the  cross-valida¬ 
tion  subsamples  formed  on  the  basis  of  the  specific  moderators  and  the 
transsituational  moderator  are  shown  in  Table  8.  The  subgroups — upperthird 
(U3),  lower  third  (L3),  upper  half  (U2)  and  lower  half  (L2)— were  formed 
on  the  basis  of  the  moderator  scores.  Subgroups  with  lower  moderator  scores 
were  predicted  to  have  higher  validity  coefficients  than  the  subgroups  with 
higher  moderator  scores,  since  lower  moderator  scores  should  indicate 
higher  predictability  and  higher  moderator  scores  lower  predictability. 

Compare  first  the  validity  coefficients  for  subgroups  formed  on  the 
basis  of  the  specific  moderators.  None  of  the  differences  between  the 
validity  coefficients  for  L3  and  U3,  or  for  L2  and  U2,  was  significantly 
different  from  zero  at  the  5#  level  (one-tailed  test)  ^  The  validity 


One-tailed  tests  were  used  unless  specified  otherwise. 

L 

Fisher 9 s  z-transformation  technique  was  used  for  all  tests  of  significance. 


COMPARISON  OF  THE  SCALES  SELECTED  FOR  THE  SPECIFIC  AND 
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coefficient  for  L3  of  the  clerical  sample  was  significantly  different  from 
zero  at  the  5$  level. 


Tests  of  statistical  significance  indicated  that  only  the  specific 
moderator  developed  on  the  clerical  sample  identified  more  and  less  pre¬ 
dictable  subgroups  upon  cross  validation.  There  was  some  tendency  for  the 
specific  moderator  scores  to  be  related  to  the  validity  coefficients. 

In  subgroups  formed  on  the  basis  of  the  transsituational  moderator, 
differences  between  validity  coefficients  for  L3  and  U3  of  the  clerical 
sample  and  the  skilled  sample  were  found  to  be  significantly  different  from 
zero  at  the  5%  level.  None  of  the  differences  between  the  validity  coeffi¬ 
cients  for  L2  and  U2  was  significantly  different  from  zero  at  the  %  level. 
The  validity  coefficient  in  L3  of  the  clerical  sample  and  validity  coeffi¬ 
cients  in  L3  and  L2  of  the  skilled  sample  were  significantly  different  from 
zero  at  the  yj>  level.  Again,  some  tendency  for  the  moderator  scores  to  be 
related  was  noted  in  the  clerical  and  skilled  samples.  The se  results  pro¬ 
vide  some  indication  that  it  is  possible  to  develop  a  transsituational 
moderator  that  identifies  more  and  less  predictable  subgroups  for  different 
occupational  groups  when  different  predictors  are  used  to  predict  the  same 
kind  of  criterion. 

The  data  were  examined  to  determine  whether  such  differential  predicta¬ 
bility  as  was  found  could  be  attributed  to  the  differential  predictability 
of  handicapped  and  nonhandicapped  individuals.  Chi  square  analyses  of  the 
data  for  the  specific  and  transsituational  moderators  indicated  that  disa¬ 
bility  and  moderator  score  (upper  half  vs  lower  half)  were  independent. 


EFFECTIVENESS  OF  THE  EMPIRICAL  MODERATORS  OF  G 

Table  9  shows  the  validity  coefficients  of  G  computed  in  the  cross- 
validation  subsamples— U3,  L3,  U2,  L2— formed  on  the  basis  of  the  specific 
moderators  and  the  transsituational  moderator. 

In  the  subgroups  formed  on  the  basis  of  the  specific  moderators,  none 
of  the  specific  moderators  was  effective  on  cross  validation  in  identifying 
more  and  less  predictable  subgroups. 

In  subgroups  formed  on  the  basis  of  the  transsituational  moderator, 
none  of  the  differences  between  the  validity  coefficients  for  L3  and  U3, 
or  for  L2  and  U2,  was  significantly  different  from  zero  at  the  5$  level. 
However,  the  validity  coefficient  in  L2  of  the  clerical  sample  was  signi¬ 
ficantly  different  from  zero  at  the  5$  level,  and  in  L2  of  the  skilled 
sample  at  the  1$  level.  The  three  values  of  L3  were  positive  and  higher 
than  the  corresponding  values  of  U3,  and  two  of  the  three  values  of  L2 
were  positive  and  higher  than  the  corresponding  values  of  U2.  These  re¬ 
sults  would  appear  to  indicate  that  it  is  possible  to  develop  a  transsitua¬ 
tional  moderator  that  Identifies  more  and  less  predictable  subgroups  for 
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different  occupational  groups  when  the  same  predictor  is  used  to  predict 
the  same  Kind  of  criterion. 

Chi  square  analysis  of  these  data  again  indicated  that  disability  and 
moderator  score  were  independent. 

Tables  8  and  9  show  that  neither  specific  nor  transsituational  moder¬ 
ators  identified  more  and  less  predictable  subgroups  of  the  nonskilled 
sample.  This  result  was  expected,  since  G  is  not  usually  an  effective  pre¬ 
dictor  of  performance  in  nonskilled  Jobs.  The  negative  results  for  M  can 
be  explained  similarly.  In  view  of  the  heterogeneity  of  the  nonskilled 
sample  in  terms  of  Job  functions,  M  was  in  all  likelihood  not  related  to 
performance  in  enough  of  the  Jobs  comprising  the  nonskilled  sample  to  pro¬ 
vide  enough  cases  from  which  to  select  a  predictable  subgroup. 

Means  and  standard  deviations  of  predictors  and  criterion  in  the  cross- 
validation  subsamples  formed  on  the  basis  of  specific  and  transsituational 
moderators  are  presented  in  Tables  10  and  11. 

IMPLICATIONS 

This  research  illustrated  a  possible  method  of  improving  the  uSe  of 
selected  aptitude  measures  as  predictors  by  identifying  subgroups  of  in¬ 
dividuals  for  which  the  aptitude  measures  are  especially  effective.  Find¬ 
ings  may  be  contrasted  with  those  of  Ghiselli  (1963b )  that  moderators 
appear  to  be  highly  specific.  With  two  different  tests  predicting  the 
gamp  criterion  for  a  given  group,  and  with  the  same  test  predicting  differ¬ 
ent  though  similar  criteria  for  two  different  groups,  the  items  which 
formed  the  moderators  were  quite  different.  A  comparison  of  the  specific 
moderators  developed  from  the  MMPI,  SVIB,  and  the  G  scale  of  the  GATB  in 
the  present  study  shows  a  similar  pattern.  With  different  tests  predicting 
the  same  kind  of  criterion  in  different  groups,  the  scales  which  formed 
the  moderators  were  quite  different.  On  the  basis  of  these  results,  con¬ 
clusion  as  to  specificity  of  the  moderators  might  have  been  the  same  as 
Ghiselli' s.  However,  this  specificity  does  not  appear  to  preclude  the  de¬ 
velopment  of  an  empirical  moderator  that  is  transsituational.  Lack  of 
overlap  in  the  items  or  scales  that  comprise  moderators  for  different  situ¬ 
ations  does  not  appear  to  be  sufficient  evidence  from  which  to  draw  the 
general  conclusion  that  moderators  are  necessarily  specific. 

The  significance  of  the  results  of  this  study  should  be  interpreted 
with  caution.  Although  evidence  does  suggest  that  different  types  of  moder¬ 
ator  are  identifying  different  individuals,  all  of  whan  are  predictable, 
it  should  be  noted  that  «n*n  samples  were  used  in  the  development  of  the 
specific  moderators.  Sampling  error  could  explain  the  difference  in  compo¬ 
sition  of  the  moderators,  and  the  apparent  discrepancy  in  their  effective¬ 
ness.  It  would  seem  reasonable  that  the  specific  moderators  would  tend  to 
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MEANS  AND  STANDARD  DEVIATIONS  OF  Q,  M,  S,  AND  THE  CRITERION  (C) 
COMPUTED  IN  SUBSAMPLES  OF  THE  CROSS-VALIDATION  SAMPLES 
FORMED  ON  THE  BASIS  OF  SPECIFIC  (SM)  AND 
TRANSSITUATIONAL  (TM)  MODERATORS 


sm _  tm 


Sample 

Scale 

U3 

U2 

L2 

L3 

U3 

U2 

L2 

L3 

N 

16 

25 

23 

15 

16 

25 

a 

14 

Q 

Mean 

116 

115 

127 

128 

117 

118 

124 

125 

Clerical 

SD 

16.7 

16.5 

18.7 

18.5 

17.9 

16.7 

20.3 

20.5 

Mean 

15.4 

15.8 

14.7 

14.5 

15.5 

15.5 

15.2 

15.6 

c 

SD 

5.50 

4.81 

4.08 

3.87 

4.12 

4.32 

4.65 

4.77 

N 

15 

22 

22 

15 

15 

22 

22 

15 

M 

Mean 

79 

81 

76 

75 

75 

75 

82 

79 

Non- 

SD 

24.6 

24.1 

22.9 

24.6 

22.6 

25.4 

25.6 

23.4 

skilled 

Mean 

14.9 

14.6 

15.0 

14.65 

13.8 

14.8 

14.7 

14.9 

C 

SD 

3.84 

5.91 

5.75 

3.62 

3.a> 

3.23 

4.54 

4.49 

N 

13 

18 

19 

15 

12 

19 

18 

15 

Q 

Mean 

106 

106 

105 

103 

104 

105 

106 

no 

Skilled 

SD 

19.2 

19.8 

15.1 

16.3 

14.7 

18.1 

17.3 

16.5 

Mean 

14.3 

15.1 

15.1 

15.1 

16.3 

16.4 

13.8 

14.7 

c 

SD 

4.11 

3.77 

4.35 

4.4o 

4.11 

4.02 

3.65 

3.56 
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Table  11 


MEANS  AND  STANDARD  DEVIATIONS  OF  G  AND  THE  CRITERION  (c) 
COMPUTED  IN  THE  CROSS-VALIDATION  SUBSAMPLES  FORMED 
ON  THE  BASIS  OF  SPECIFIC  (SM)  AND  TRANSSITUATIONAL 
(TM)  MODERATORS 


SM  _ TM 


Sample 

Scale 

U3 

U2 

L2 

13 

U3 

U2 

L2 

L3 

N 

15 

23 

23 

15 

16 

25 

21 

14 

G 

Mean 

106 

113 

119 

119 

11 6 

116 

111 

112 

Clerical 

SD 

17.2 

17.2 

13.1 

14.3 

10.5 

U.5 

19.8 

16.9 

Mean 

lU.9 

14.9 

15.6 

15.3 

14.8 

15.9 

l4.6 

l4.6 

C 

SD 

4.6l 

4.66 

4.00 

4.23 

4.94 

4.81 

3.91 

3.79 

N 

15 

22 

22 

15 

15 

22 

22 

15 

G 

Mean 

94 

95 

95 

92 

108 

102 

88 

85 

Non- 

SD 

19.2 

22.0 

15.5 

16.4 

16.9 

17.2 

17.9 

17.6 

skilled 

Mean 

14.2 

14.7 

14.9 

15.1 

15.3 

l4.8 

14.9 

14.9 

C 

SD 

3.63 

3.52 

4.09 

5.48 

4.34 

4.42 

3.12 

3.27 

N 

13 

19 

18 

12 

13 

3D 

17 

12 

Mean 

108 

106 

98 

93 

96 

99 

106 

100 

Skilled 

G 

SD 

14.4 

17.3 

14.4 

13.3 

14.2 

17.3 

14.4 

9.6 

C 

Mean 

15.8 

15.8 

14.3 

14.4 

15.6 

15.5 

14.6 

13-5 

SD 

4.23 

4.23 

3.73 

3.39 

3.98 

3.90 

4.19 

3.90 
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be  more  effective  than  the  transsituational  moderators.  In  this  present 
study,  there  was  a  tendency  for  the  transsituational  moderators  to  show  up 
as  more  effective.  The  use  of  comparable  sample  sizes  for  the  empirical 
development  of  specific  and  transsituational  moderators  would  give  a 
better  assessment  of  the  relative  effectiveness  of  these  moderators  and 
the  extent  to  which  they  show  common  scales  of  items. 
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